Extracting Evaluation Criteria for Evaluating Ontology Quality

Criteria and Evaluation for Ontology Modularization Techniques

While many authors have argued for the benefits of applying principles of modularization to ontologies, there is not yet a common understanding of how modules are defined and what properties they should have. In the previous section, this question was addressed from a purely logical point of view. In this chapter, we take a broader view on possible criteria that can be used to determine the qua...

Criteria For Evaluating Usability Evaluation Methods

Among interactive system developers and users there is now much agreement that usability is an essential quality of software systems. The introduction of usability evaluation methods (UEMs) to assess and improve usability in such systems has led to a variety of alternative approaches and a general lack of understanding of the capabilities and limitations of each. This confusion has intensified ...

Evaluation criteria for information quality research

Evaluation of research artefacts (such as models, frameworks and methodologies) is essential to determine their quality and demonstrate worth. However, in the IQ research domain there is no existing standard set of criteria available for researchers to use to evaluate their IQ artefacts. This paper therefore describes our experience of selecting and synthesizing a set of evaluation criteria use...

Perceptual Criteria for Image Quality Evaluation

Evaluating Evaluation Metrics for Ontology-Based Applications: Infinite Reflection

In this paper, we discuss methods of measuring the performance of ontology-based information extraction systems. We focus particularly on the Balanced Distance Metric (BDM), a new metric we have proposed which aims to take into account the more flexible nature of ontologically-based applications. We first examine why traditional Precision and Recall metrics, as used for flat information extract...